LISTING OF CLAIMS: 



1 . (Previously Presented) A method for automatically determining a 
foreground color for a digital image, comprising: 

(a) automatically dividing the colors of the pixels of at least a part of the 
digital image into a number of color clusters in a color space; 

(b) automatically segmenting the part of the digital image into regions 
according to the color clusters; 

(c) automatically grouping the color clusters into interference clusters 
comprising a pixel in a selected region of the image and benign clusters comprising no 
pixel in the selected region; 

(d) automatically selecting a foreground color being related to at least 
one interference cluster according to predetermined criteria and the foreground color 
being selected according to a color harmony criterion with respect to at least one benign 
cluster; and 

(e) one of automatically displaying, storing and communicating data 
representing the selected foreground color. 

2. (Previously Presented) The method according to claim 1 , wherein said 
selecting at (d) further comprises: 

selecting a harmonious color set with respect to the color clusters; and 
testing the harmonious color set for legibility. 

3. (Previously Presented) The method according to claim 2, wherein said 
testing the harmonious color set for legibility further comprises: 

computing local measures of contrast between a background and the foreground 
in a neighborhood of a predetermined foreground region; and 

computing a legibility score representative of a lowest few contrast values 
observed over the predetermined foreground region. 
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4. (Previously Presented) The method according to claim 2, wherein the 
foreground color is selected according to a legibility criterion for a predetermined 
foreground region by: 

computing local measures of contrast between background and foreground in a 
neighborhood for a predetermined foreground region; and 

computing a legibility score representative of a lowest few contrast values 
observed over the predetermined foreground region. 

5. (Original) The method according to claim 1 , wherein said dividing at (a) 
comprises converting the image data to a predetermined color format. 

6. (Original) The method according to claim 1 , wherein said dividing at (a) 
comprises using an Expectation-Maximization clustering. 

7. (Original) The method according to claim 1 , wherein said dividing at (a) 
comprises determining the number of clusters using a model selection method one of a 
Bayesian Information Criterion and a Universal Model-based Minimum Description 
Length Principle. 

8. (Canceled) 

9. (Previously Presented) The method according to claim 1 , wherein the 
segmenting comprises using one of a normalized cut criterion and an energy- 
minimization method. 

10. (Canceled) 

1 1 . (Previously Presented) The method according to claim 1 , wherein the 
foreground color is selected according to a legibility criterion for a predetermined 
foreground region. 
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12. (Previously Presented) The method according to claim 1 1 , wherein the 
foreground color is selected based on a likelihood ratio of the hypothesis that the digital 
image contains the foreground region and the hypothesis that the digital image does not 
contain the foreground region. 

13. (Previously Presented) The method according claim 12, wherein selecting 
the foreground color comprises computing the legibility of *"SV n ™cf r ^ x + y \ wherein 

, ... Pr(/ (*) j T) 

r{x) ~ hl0B P T (i( X )\B), C 2 e is a disc of radius £ and wherein Pr(/ (x) \ T) denotes 
heuristic or other models of likelihoods that the image / contains text T at a given 
pixel x and Pr(/(x) j B) denotes heuristic or other models of likelihoods that the image 

/ contains background B at the given pixel x 

14. (Canceled) 

15. (Previously Presented) The method according to claim 1 , wherein the 
foreground color is selected according to at least one of a monotonic, a complementary, 
and a p-adic color harmony criterion in HSL space. 

16. (Previously Presented) The method according to claim 1 , wherein the 
foreground color is selected according to a color harmony criterion with respect to at 
least one interference cluster. 

17. (Canceled) 

18. (Previously Presented) The method according to claim 1 , wherein the 
foreground color is selected according to a color harmony criterion with respect to all 
interference clusters and at least one benign cluster. 
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19. (Previously Presented) The method according to claim 1 , wherein said 
selecting at (d) comprises determining a color subset according to a color harmony 
criterion and maximizing a legibility function in the color subset. 

20. (Previously Presented) The method according to claim 1 , wherein the 
foreground color is selected for which X a M c ^ P i) + ^nKc,K k ) - IS maximal, wherein c 
denotes the foreground color, P, denote the interference clusters, K k denote all 
clusters, both benign and interference, / is a legibility function in color space, h is a 
color harmony function, and « t .and 7 k are weighting factors. 

21 . (Previously Presented) The method according to claim 1 , further 
comprising one of displaying and storing a predetermined object using the selected 
foreground color together with the digital image. 

22. -25. (Canceled) 

26. (Previously Presented) An apparatus for automatically determining a 
foreground color for a digital image comprising: 

a processor which executes computer readable instructions, stored in a 
memory, to perform the method comprising: 

(a) automatically dividing the colors of the pixels of at least a part of the 
digital image into a number of color clusters in a color space; 

(b) automatically segmenting the part of the digital image into regions 
according to the color clusters; 

(c) automatically grouping the color clusters into interference clusters 
comprising a pixel in a selected region of the image and benign clusters comprising no 
pixel in the selected region; 
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(d) automatically selecting a foreground color being related to at least 
one interference cluster according to predetermined criteria and the foreground color 
being selected according to a color harmony criterion with respect to at least one benign 
cluster; and 

(e) one of automatically displaying, storing and communicating data 
representing the selected foreground color. 

27. (Previously Presented) The apparatus according to claim 26, wherein said 
selecting at (d) further comprises: 

selecting a harmonious color set with respect to the color clusters; and 
testing the harmonious color set for legibility. 

28. (Previously Presented) The apparatus according to claim 27, wherein said 
testing the harmonious color set for legibility further comprises: 

computing local measures of contrast between background and foreground in a 
neighborhood of a predetermined foreground region; and 

computing a legibility score representative of a lowest few contrast values 
observed over the predetermined foreground region. 

29. (Previously Presented) A computer program product comprising: 

a computer-usable memory device storing instructions that, when executed by a 
computer, cause the computer to perform a method comprising: 

(a) automatically dividing the colors of the pixels of at least a part of the digital 
image into a number of color clusters in a color space; 

(b) automatically segmenting the part of the digital image into regions 
according to the color clusters; 

(c) automatically grouping the color clusters into interference clusters 
comprising a pixel in a selected region of the image and benign clusters comprising no 
pixel in the selected region; 
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(d) automatically selecting a foreground color being related to at least one 
interference cluster according to predetermined criteria and the foreground color being 
selected according to a color harmony criterion with respect to at least one benign 
cluster; and 

(e) one of automatically displaying, storing and communicating data 
representing the selected foreground color. 

30. (Previously Presented) The computer program product according to claim 

29, wherein said selecting at (d) further comprises: 

selecting a harmonious color set with respect to the color clusters; and 
testing the harmonious color set for legibility. 

31 . (Previously Presented) The computer program product according to claim 

30, wherein said testing the harmonious color set for legibility further comprises: 

computing local measures of contrast between background and foreground in a 
neighborhood of a predetermined foreground region; and 

computing a legibility score representative of a lowest few contrast values 
observed over the predetermined foreground region. 
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